The challenge of transfer to clinical practice: The illusion of learning and illusion of teaching.

There is increasing pressure to accelerate health professions education programs and educators have the challenge of ensuring that students can effectively transfer their learning into clinical practice. In this personal view, we discuss how insights from cognitive science can inform the redesign of current curricula and highlight the challenge of implementing these new approaches for instructional design and assessment. We also recommend that educators disseminate the important lessons learned from their endeavors.

Use of eye tracking in medical education.

Eye tracking has become increasingly applied in medical education research for studying the cognitive processes that occur during the performance of a task, such as image interpretation and surgical skills development. However, analysis and interpretation of the large amount of data obtained by eye tracking can be confusing. In this article, our intention is to clarify the analysis and interpretation of the data obtained from eye tracking. Understanding the relationship between eye tracking metrics (such as gaze, pupil and blink rate) and cognitive processes (such as visual attention, perception, memory and cognitive workload) is essential. The importance of calibration and how the limitations of eye tracking can be overcome is also highlighted.

Self-regulated learning microanalysis feedback for developing clinical skills: A pilot study.

INTRODUCTION: The development of clinical skills requires the appropriate use of self-regulated learning (SRL). Students' use of key SRL processes as they perform a clinical skill can be identified by SRL microanalysis and used to provide feedback. SRL-microanalysis feedback only on students' key SRL processes has not been previously researched for developing clinical skills. The aim of this study was to investigate whether SRL-microanalysis feedback only on students' key SRL processes can improve both their use of SRL and their clinical skill performance. METHODS: Twenty-three final year medical students with no experience in the clinical skill required for mechanical ventilation participated in this study. Key SRL processes and clinical skill performance were measured before and after SRL microanalysis feedback. RESULTS: Overall, we found an improvement in the key SRL processes of planning and monitoring of performance, with a significant difference in monitoring. We also found an increase in students' clinical skill performance. DISCUSSION: This study, which is the first in clinical skills, demonstrated that SRL microanalysis feedback only on key SRL processes can improve both students' SRL and their clinical skill performance. studies are recommended with a great number of students and across a variety of clinical skills.

Lessons learned from the impact of the COVID-19 pandemic in Brazil on primary-care workplace learning groups.

Background: The COVID-19 pandemic in Brazil had a major impact on face-to-face permanent education for health (PEH) workplace learning groups in primary care. Aims: The aim of the study was to explore how PEH groups in primary care changed during the COVID-19 pandemic. Methods: A qualitative exploratory evaluation study was conducted with six key participants, who answered semi-structured questions in on-line interviews. Results: The PEH groups rapidly and successfully implemented an online approach using social media. The role of the coordinator changed from being a facilitator to an information broker for navigating the large volume of conflicting information and misinformation. Conclusions: The findings highlight the importance of being an agile organisation, with a 'bottom-up' approach to innovation, and the key role of having an information broker in rapidly changing and complex environments. An appreciation of the importance of the socio-technical system for technology implementation in an organisation was also highlighted, with the use of technologies that are familiar to members of the organisation.

Implementation of Escape Room as an Educational Strategy to Strengthen the Practice of Safe Surgery.

OBJECTIVE: Describe a safe surgery learning experience based on interactive escape room activities to engage and train nursing and physician teams. DESIGN: This paper is based on the authors' participatory and observational experiences creating the Escape Room activity. SETTING: Jundiai Regional Hospital, Surgical Department. PARTICIPANTS: Nurses, nurses assistant/technician and physicians and medical residents who work in the surgical center. RESULTS: Results identified were promising, which broadens the perspective for further studies using the Escape Room activity in the hospital environment through structured research that can assess its implications for teaching and learning. CONCLUSION: We see opportunities for using the escape room activity as a teaching tool to implement other learning objectives.

Self-regulated learning processes across different physiotherapy clinical procedural skills and time intervals: A SRL microanalysis study.

PURPOSE OF THE STUDY: The performance of a clinical procedural skill by an individual student is associated with their use of Self-Regulated Learning (SRL) processes. However, previous research has not identified if an individual student has a similarity in their use of SRL processes across different clinical procedural skill tasks and at a time interval. The aim of this pilot study was to explore the similarity in the use of SRL processes by individual students across different clinical procedural skill tasks and at a time interval. METHODS: SRL-microanalysis was used to collect within-subject data on undergraduate physiotherapy students' use of the two key SRL processes (planning and monitoring) during their performance of different goniometry clinical procedural skills tasks and also at a fourth month interval. RESULTS: An individual student's use of key SRL processes across different clinical procedural skill tasks and at a time interval was similar. Also, this similarity was identified for students with initial successful and unsuccessful performances. CONCLUSION: Our findings have implications for the future wider practical implementation of SRL microanalysis to inform personalised SRL feedback for developing the clinical procedural skills of individual students. Further research with a greater number of students and across a wider range of clinical procedural skills will be required to confirm our findings, and also its effectiveness on feedback and future performance.

Identifying the response process validity of clinical vignette-type multiple choice questions: An eye-tracking study.

INTRODUCTION: Clinical vignette-type multiple choice questions (CV-MCQs) are widely used in assessment and identifying the response process validity (RPV) of questions with low and high integration of knowledge is essential. Answering CV-MCQs of different levels of knowledge application and integration can be understood from a cognitive workload perspective and this can be identified by using eye-tracking. The aim of the pilot study was to identify the cognitive workload and RPV of CV-MCQs of different levels of knowledge application and integration by the use eye-tracking. METHODS: Fourteen fourth-year medical students answered a test with 40 CV-MCQs, which were equally divided into low-level and high-level complexity (knowledge application and integration). Cognitive workload was measured using screen-based eye tracking, with the number of fixations and revisitations for each area of interest. RESULTS: We found a higher cognitive workload for high-level complexity (M = 121.74) compared with lower-level complexity questions (M = 51.94) and also for participants who answered questions incorrectly (M = 94.31) compared with correctly (M = 79.36). CONCLUSION: Eye-tracking has the potential to become a useful and practical approach for helping to identify the RPV of CV-MCQs. This approach can be used for improving the design and development of CV-MCQs, and to provide feedback to inform teaching and learning.[Box: see text].

Using insights from cognitive science for the teaching of clinical skills: AMEE Guide No. 155.

Students have to develop a wide variety of clinical skills, from cannulation to advanced life support, prior to entering clinical practice. An important challenge for health professions' educators is the implementation of strategies for effectively supporting students in their acquisition of different types of clinical skills and also to minimize skill decay over time. Cognitive science provides a unified approach that can inform how to maximize clinical skill acquisition and also minimize skill decay. The Guide discusses the nature of expertise and mastery development, the key insights from cognitive science for clinical skill development and skill retention, how these insights can be practically applied and integrated with current approaches used in clinical skills teaching.

A Hemodynamic Echocardiographic Evaluation Predicts Prolonged Mechanical Ventilation in Septic Patients: A Pilot Study.

Prolonged mechanical ventilation (PMV) is common among critically ill septic patients and leads to serious adverse effects. Transthoracic echocardiography (TTE) is an efficient tool for the assessment of septic shock. Our study investigated the relationship between TTE parameters and PMV in mechanically ventilated septic shock patients. TTE was performed in the first 24 h of intensive care unit admission, acquiring data on cardiac output (CO), cardiac index (CI), s' wave (s'), E wave (E), e' wave (e') and E/e' ratio. We compared data on patients who met the criteria for PMV with data on patients who did not. Sixty-four patients were included, 26 of whom met the criteria for PMV. CO, CI and s' were higher in patients who required PMV (5.49 vs. 4.20, p = 0.02; 2.95 vs. 2.34, p = 0.04; and 12.56 vs. 9.81, p = 0.01, respectively). CI correlated with s' (r = 0.37, p < 0.01). The areas under the receiver operating characteristic curves for CO, CI and s' in assessing the need for PMV were, respectively, 0.7 (fair results), 0.69 and 0.68 (poor results). Despite a lack of a prognostic model, the observed differences suggest that hemodynamic TTE could provide information on the risk of PMV in septic shock.

Satisfaction of the ophthalmology residents with online progress test / Satisfação dos residentes de oftalmologia com testes de progresso online

ABSTRACT Objective To investigate if there is knowledge improvement over the Residency years, as well as students' satisfaction about progress test. Finally, to describe the implementation of the online progress test in some Ophthalmological Residency programs in Brazil. Methods It was an observational cross-section study. The participants were all Ophthalmology residents who accepted to join the study. They did an online test and answered demographic and satisfaction questionnaires. Results Two hundred and fifty-nine residents joined the study. 42,86% of the residents answered the demographic questionnaire and 6,95% answered the satisfaction questionnaire. In general, the residents approved the website as a tool for self-learning and to improve residency programs. Conclusion Over the years, the residents acquired knowledge during the residency program. In general, residents were satisfied with the test. The implementation of the online progress test system in the Ophthalmological Residency schools in Brazil was successful.

RESUMO Objetivo Avaliar se ocorre melhora do desempenho na prova dos residentes ao longo dos anos de curso e o grau de satisfação dos residentes com o teste de progresso. Além disso, descrever a implementação do teste de progresso em alguns serviços de residência em oftalmologia no Brasil. Métodos Estudo observacional prospectivo. Os participantes foram todos os residentes de Oftalmologia que aceitaram participar do estudo. Eles fizeram um teste online e responderam a um questionário pessoal e um de satisfação. Resultados Duzentos e cinquenta e nove residentes participaram do estudo. 42,86% dos residentes responderam o questionário pessoal e 6,95% responderam o questionário de satisfação. Em geral, os residentes aprovaram o site como instrumento de autoaprendizado e como instrumento para melhoria dos programas de residência. Conclusão Houve aquisição de conhecimento dos residentes ao longo do curso. De um modo geral, os residentes ficaram satisfeitos com o teste. A implementação do teste de progresso nos serviços de residência de Oftalmologia foi bem-sucedida.

Longitudinal evaluation of the Ophthalmology residents in Brazil: an observational prospective study

ABSTRACT BACKGROUND: The longitudinal evaluation of students seems to be a better way to assess their knowledge compared with that of the traditional methods of evaluation, such as modular and final tests. Currently, progress testing is the most consolidated type of longitudinal testing method. However, despite being well consolidated as an assessment tool in medical education, the use of this type of test in residency programs is scarce. OBJECTIVES: This study aimed to investigate residents' knowledge growth regarding residency training and to describe the implementation of a longitudinal evaluation test in ophthalmological residency training across several medical schools in Brazil. Finally, the study aimed to check whether performance in the tests can be used as a predictor of the results of the specialist title test. DESIGN AND SETTING: This was a prospective observational study. This study was conducted using an online platform. METHODS: Online tests were developed following the same pattern as the Brazilian Ophthalmology Council specialist tests. All the residents performed the test simultaneously. The tests were conducted once a year at the end of the school year. RESULTS: A progress test was conducted across 13 services with 259 residents. Our results demonstrated that resident scores improved over the years (P < 0.0001) and had a moderate correlation with the Brazilian Opthalmology Council specialist test (P = 0.0156). CONCLUSION: The progress test can be considered a valuable tool to assess knowledge, meaning their knowledge increased over residency training. In addition, it can be used as a predictor of the result in the specialist title test.

Longitudinal evaluation of the Ophthalmology residents in Brazil: an observational prospective study.

BACKGROUND: The longitudinal evaluation of students seems to be a better way to assess their knowledge compared with that of the traditional methods of evaluation, such as modular and final tests. Currently, progress testing is the most consolidated type of longitudinal testing method. However, despite being well consolidated as an assessment tool in medical education, the use of this type of test in residency programs is scarce. OBJECTIVES: This study aimed to investigate residents' knowledge growth regarding residency training and to describe the implementation of a longitudinal evaluation test in ophthalmological residency training across several medical schools in Brazil. Finally, the study aimed to check whether performance in the tests can be used as a predictor of the results of the specialist title test. DESIGN AND SETTING: This was a prospective observational study. This study was conducted using an online platform. METHODS: Online tests were developed following the same pattern as the Brazilian Ophthalmology Council specialist tests. All the residents performed the test simultaneously. The tests were conducted once a year at the end of the school year. RESULTS: A progress test was conducted across 13 services with 259 residents. Our results demonstrated that resident scores improved over the years (P < 0.0001) and had a moderate correlation with the Brazilian Opthalmology Council specialist test (P = 0.0156). CONCLUSION: The progress test can be considered a valuable tool to assess knowledge, meaning their knowledge increased over residency training. In addition, it can be used as a predictor of the result in the specialist title test.

Implementation and Assessment of Lung Ultrasound Training Curriculum for Physiotherapists With a Focus on Image Acquisition and Calculation of an Aeration Score.

Described here is the implementation of a lung ultrasound course for physiotherapists focused on the acquisition and retention of knowledge and skills. Initially, we provided online lectures in a virtual learning environment (VLE), in which we taught the semiquantification of edema through a lung ultrasound score (LUS). Afterward, the physiotherapists participated in face-to-face lectures (which resumed the online lectures), followed by hands-on training and simulation with ultrasound. We assessed knowledge acquisition through a multiple-choice test with 30 questions (totaling 10 points). The test was applied before accessing the VLE (pre-VLE), before the face-to-face course and at its end (pre- and post-course). Physiotherapists collected actual patients' ultrasound scans, which were uploaded to the VLE and assessed by three supervisors, who performed a consensus LUS calculation and gave virtual written feedback. Thirteen physiotherapists collected 59 exams. The test results were 3.60 ± 1.58 (pre-VLE), 5.94 ± 1.45 (pre-course) and 8.50 ± 0.71 (post-course), with p < 0.001 for all. The intraclass correlation coefficient for LUS between physiotherapists and supervisors was 0.814 (p < 0.001), with moderate-to-weak agreement for LUS of the lung apical, median and basal zones, with κ = 0.455.334, and 0.417 (p < 0.001 for all). Trainees were found to have increased short-term acquisition and retention of knowledge and skills, with a good intraclass correlation coefficient between them and the consensus of supervisors for the LUS of actual patients.

Application of telesimulation in a medical undergraduate course during the SARS-CoV-2 pandemic: a quantitative and retrospective study

ABSTRACT BACKGROUND: Because of the social isolation and distancing measures that were imposed to stop the spread of coronavirus disease 19 (COVID-19), new ways of teaching were implemented. OBJECTIVES: To describe the implementation of telesimulation and seek to assess students' perceptions regarding telesimulation. DESIGN AND SETTING: Retrospective quantitative study conducted within the hospital simulation at a private medical school in São Paulo, Brazil. METHODS: After telesimulation training, students answered a questionnaire that provided an overall assessment of this activity, self-assessment and assessments of the facilitators and infrastructure provided by the University. RESULTS: Among the students, 50% reported that the activity was below expectations and 45% reported that it was in line with their expectations. The strong points of the activity were the clinical cases, workload and teachers. The main challenge was students' difficulty in reflecting on their learning and the infrastructure. CONCLUSIONS: Since students have less experience and fewer clinical encounters than residents or professionals, they also face more difficulty. Although telesimulation may have provided a valid alternative to replace simulation training during the COVID-19 pandemic, more face-to-face activities should be offered to students, when possible.

Application of telesimulation in a medical undergraduate course during the SARS-CoV-2 pandemic: a quantitative and retrospective study.

BACKGROUND: Because of the social isolation and distancing measures that were imposed to stop the spread of coronavirus disease 19 (COVID-19), new ways of teaching were implemented. OBJECTIVES: To describe the implementation of telesimulation and seek to assess students' perceptions regarding telesimulation. DESIGN AND SETTING: Retrospective quantitative study conducted within the hospital simulation at a private medical school in São Paulo, Brazil. METHODS: After telesimulation training, students answered a questionnaire that provided an overall assessment of this activity, self-assessment and assessments of the facilitators and infrastructure provided by the University. RESULTS: Among the students, 50% reported that the activity was below expectations and 45% reported that it was in line with their expectations. The strong points of the activity were the clinical cases, workload and teachers. The main challenge was students' difficulty in reflecting on their learning and the infrastructure. CONCLUSIONS: Since students have less experience and fewer clinical encounters than residents or professionals, they also face more difficulty. Although telesimulation may have provided a valid alternative to replace simulation training during the COVID-19 pandemic, more face-to-face activities should be offered to students, when possible.

Solutions, enablers and barriers to online learning in clinical medical education during the first year of the COVID-19 pandemic: A rapid review.

AIMS: The COVID-19 pandemic has seen a major disruption to undergraduate and postgraduate clinical medical education. The aim of this rapid review was to identify and synthesize published literature relating to the solutions, enablers and barriers to online learning implemented in clinical medical education during the first year of the COVID-19 pandemic. METHODS: All articles published before March 2021 in peer-reviewed journals, including MedEdPublish, that described authors' experience of online learning in response to the COVID-19 pandemic. A descriptive analysis of the solutions and a qualitative template analysis of enablers and barriers. RESULTS: 87 articles were identified for inclusion. Face to face teaching was maintained with interactive approaches between learners and/or learners and teachers. Several innovative solutions were identified. The enablers were a readiness and rapid response by institutions, with innovation by teachers. The barriers were the lack of planning and resources, usability problems and limited interactivity between teachers and students. CONCLUSIONS: Important and timely evidence was obtained that can inform future policy, practice and research. The findings highlighted the urgent need to use rapid design and implementation methods with greater explicit descriptions in published articles to ensure applicability to other contexts.